Column
Metadata
Raw
Bird records - brief version
File size: 6.0 GB unzipped .csv format – (1.3 GB .zip compressed)
Dimensionality: >3,000,000 obs x 9 vars
Available: download.ala.org
Cleaned
File size: 6.0 GB unzipped .rda format – (1.3 GB .zip compressed)
Dimensionality: 2,740,000 obs x 9 vars (drop 4, add 4 date var)
Team nassTea
Nick, Abby, Sium, Sayani (Tea, with)
Suggested viewing:
125% zoom from Firefox or Chrome
Column
Lesson 1, Start work earlier, work smarter
niave approach
for (i in 1:n_mil) {
load(... , nrow = 1e6, skip = (i - 1) * 1e6)
clean()
filter()
save(...)
rm(list = ls()) # Sorry Jenny Bryan, I'll keep an extinguisher handy.
}
load(1:n_mil)
rbind(1:n_mil)
save(...)
rm(list = ls()) # Sorry Jenny Bryan, I'll keep an extinguisher handy.
load(1:n_mil)
sample_n(dat, n = 5000)Next iteration
- Put up a mangoDB
- Bring our dplyr::s
- ggplot(space, frame=time) %>% plotly::ggplotly()
EDA 1
EDA 2
